"The highlighted tokens are frequently grammatical particles, affixes, or short function words in various languages, often marking aspects such as negation, comparison, possession, or subordination. These tokens are typically high-frequency morphemes or syllables that play a key role in sentence structure and meaning, especially in agglutinative or analytic languages."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.5 | 0.5 | 0.96 | 0.658 | 0.96 | 0.04 | 0.96 | 0.04 |
fuzz | 0.51 | 0.505 | 0.96 | 0.662 | 0.96 | 0.06 | 0.94 | 0.04 |